arXiv:1504.02438vl [math.PR] 9 Apr 2015 


Scaling limits for exploration algorithms 


P. Bermolen, M. Jonckheere, J. Sanders 
April 10, 2015 


Abstract 

We consider an exploration algorithm where at each step, a random number of items become 
active while related items get explored. Given an initial number of items N growing to infinity and 
building on a strong homogeneity assumption, we study using scaling limits of Markovian processes 
statistical properties of the proportion of active nodes in time. This is a companion paper that 
rigorously establishes the claims and heuristics presented in [5] . 

1 Introduction 

Assume there exists a binary relation between items V = {l,...,iV}, to which we associate a 
graph where nodes are items such that two items are neighbors if they are related. Let At be the 
set of active items at time t (step t) and Bt the set of explored items. We assume that initially, 
Aq = Bq = {0}. Then, we consider the following exploration process: (i) select B C V\AtUBt 
and determine its neighbors in the set of nonexplored items, C V \ AtU Bt, and (ii) actualize 
At and Bt by setting 


At+i — AtU {It}, 

Bt+i =BtUAf^*. 

These exploration algorithms can be used for instance to approximate the evolution of parking 
processes [2] and as we shall show, classes of random sequential adsorption processes. In case 
B is a single item at each step, the algorithm discovers in a greedy manner independent sets of 
the relation graph. For instance, this type of exploration algorithm is used for defining subsets 
of communicating nodes in communication networks with interferences. Otherwise, one can think 
of B as a subgraph, and Bt the set of neighbors of this subgraph. Again, it might be linked to 
communications procedures where parts of a network might get priority to transmit. 

In such problems, the relation graph might be the outcome of spatial effects (nodes interacting 
though a geometry which can be itself random) and purely random relations between nodes. This is 
definitely the case of wireless networks which have radio conditions defining the level of admissible 
interference between two competing nodes. A hardcore interference graph model might hence define 
an edge between two nodes if their radio conditions would impede a synchronous communication. 

Blockade effects in complex systems of interacting particles can also be described using relation 
graphs. Of particular interest to us are specially prepared gases that consist of ultracold atoms 
that can reach a “Rydberg state” from a “ground state”. The essential feature of these particles 
is that each atom that is in its Rydberg state, prevents neighboring atoms from reaching their 
Rydberg state. This is similar in spirit to the interference constraints in wireless networks [^, 
and the essential features of the blockade effect can therefore again be described using interference 
graphs. This realization also allows us to study statistical properties of the proportion of atoms 
ultimately in the Rydberg state through the exploration process defined above 
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Note that in general, the dimension needed to represent the exploration algorithm as a Markov 
process is n, the size of the graph which impedes simple computations. In this article, we suppose 
a strong homogeneity assumption on the relation between items so that the dynamics can be made 
Markov in dimension 1 which is a very crude simplification for most problems but which has the 
great advantage to lead to simple tractable processes. We here use classical tools (fluid limits 
and diffusion approximations) to derive computable characterizations of the performance of such 
algorithms under such an assumption. These results allow us to prove functional laws of large 
numbers and central limit theorems for the proportion of active items. 

This article is structured as follows. In Section [21 we study the case of random sequential 
adsorption (RSA) under an homogeneity assumption. We first review usual functional law of large 
numbers and central limit theorems for scaled Markov processes aiming at explicit error bounds. 
We then use these results to study hitting times that capture statistical properties of the proportion 
of active nodes. 


2 Random adsorption under an homogeneous relation 

Assume from here on that precisely one item is selected in each step. Assume also the following 
homogeneity assumption on the graph Q induced by the binary relation between items. 

Assumption 2.1. If {Gi,G 2 ) is a partition of G, ^ i & G 2 , the distribution of the number of 
neighbors of i in G 2 depends only on \Gi\ and \G 2 \- 

Remark 2.2. Although Assumption i2.1\} is not valid in many practical cases such as random 
geometric graphs and random graphs with generic degree distribution, Assumption i2.1\} is crucial 
to get a one-dimensional analysis. It can however be considered a reasonable approximation for 
many systems, and it is satisfied for instance by Erdds-Renyi’s random graph. See for a study 
of scaling limits in infinite dimension which applies to a much larger class of problems. 

Let Zn be the number of explored items at step n, i.e. = ^{An U Bn}. Then, 

Zn = Zn—i + 1 + Cn and Zq = 0, 

where is the distribution of the number of neighbors that an item has at step n in the remaining 
non-explored portion of the graph. 

Under Assumption (EH) the distribution of depends only on Zn-i, which with a slight abuse 
of notation we denote by This also implies that Z = {Z„}„gN is a discrete Markov process 

taking values in {0,..., N}, and that Z is an increasing process with in N an absorbing state. The 
transition probabilities are given by 

Pxy{n) = P{Zn = y\Zn-i = x) = = y - X - 1) with y>x. 

If we now denote by (pAr(-,a:)) the distribution of the number of neighbors in G 2 of a given vertex 
i & G 2 given that {Gi,G 2 ) is a partition of G with \Gi\ = x, the transition probabilities can be 
written as 


Pic.x+fc+i = P{£.x = k) = pN{k, x) with fc > 0. 

The transition probabilities in case of the Erdbs-Renyi random graph are given by the Binomial 
distribution, i.e.pM{k,x) = — p)^~^~^~^. 
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2.1 Preliminaries 

2.1.1 Functional law of large numbers 

Given a partition (Gi,G 2 ) of G such that \Gi\ = x, we consider the mean ^n(x) and variance ipN^x) 
of the number of neighbors in G 2 of a given vertex i G G 2 


N-l 

iNix) = ^ kpN{k,x), 
k=0 

N-l 

fpNix) = y^ {k- 7jv(a:))^pjv(fc,a:), 
fc=0 

and define 7jv = sup^, 7 Ar(x), ipN = sup^, ipNix). 

We now consider the scaled process on time and space. Define the scaled process, viewed as a 
piece-wise constant trajectory process in continuous time, i.e., for alH > 0 

„7V _ ^[tN] 

‘ N 


Here, [x] is the integer part of x, and we suppose that Zq = 0. We will now derive a law of large 
numbers for using classical tools [3]- The proof of convergence relies on classical techniques, 
which we leverage to obtain error bounds along the way. 

Proposition 2.3. If there exists a (CrJ-Lipschitz function 7 on R’*' such that 


sup 




< Sn, 


( 1 ) 


then for p > 1, 

II sup \Zf-zis)\\\p<eMCLT}{SNT + Kp\\M^\\p), (2) 

sG[ 0.T] 

where Kp = p/{p — 1). In particular for p = 2, 


II sup \Z^{t) - z{t)\ II 2 < WAT, 

te[o,T] 


where lon = {SnT+2^2CnT) expICiT}, Cn = '4’n/N, and z{t) is the solution of the deterministic 
differential equation 


z = 1 + l{z). 


(3) 


Proof. Using the martingale decomposition of the Markov process Z^ we have 

i 

Zi = Zo + Y,{^ + 1n{Z^))+Mi, (4) 

i=0 

where Mi is a local martingale which is actually a global martingale since the state space is finite. 
Scaling iD, and viewing its trajectory as piece-wise constant, it follows that 


„N _ Z[tN] 

* N 


ryN 

Zq 

ryN 

^0 


. [tJV] 

i=0 


M[tN] 

N 


I rltN] 

J {i + lN{Zs))ds + 


M[tN] 

N 


ryN 

^0 


n[t] 


(1 + ')N{ZuN))du + M^ 


N 


(5) 
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where the latter equality follows from a change of variables, and an introduction of notation for 
the scaled martingale, 

Using the integral version of ®, the triangle inequality, and Lipschitz continuity of 7 , we find 
that 


sup |Zf-z(s)|< sup {\Zq -z{fi)\+ [ Ijn^Zun)-" f{ziu))\du+\M^\\ 
s6[0,t] se[0,i] ^ Jo ' 

/•[t] 

< \Z^ — z{0)\ + CL / sup \Z^ - z{u)\ds + 5Nt+ sup \M^\ 

Jo uG[ 0 ,s] sG[ 0 ,t] 

< \Zq - z{0)\ + Cl f sup \Z^ - z{u)\ds + SNt + sup \Mf\. 

Jo uefo.sl selo.il 


( 6 ) 


Define = sup \Z^ — z(s)|, so that from ([S]) it follows that 

sG[0.T] 


eN{T) < \Z^ - z(0)| + SnT + sup \M^\ + Cl f eN{s)ds. 

se[o,t] Jo 

Recall that Zq = z(0) = 0, and because 6nT + sup^^jQ-rj is nondecreasing in T, it follows 

from Gronwall’s lemma that 


eN{T) < {SnT + sup \M^\) expICiT}. 

sG[0.T] 

Using Minkowsky’s inequality for p € [l,oo), strict monotonicity of expICiT} and SnT, and the 
triangle inequality, we find 

lkw(T)||p < exp{C'Lr}(djvT+II sup |Mj^|||p). 

sG[0.T] 


Finally, using Doob’s martingale inequality for p > 1, we obtain 


\\eN{T)\\p<exp{CLT}{SNT + tip\\M^\\p). 


(7) 


In this inequality can be further simplified by computing the increasing process associated 
to the martingale, i.e. for I > 0 , 


i 

E[{Mi)^] = E[{Mi)] = e[^ Var[7w(Z,)] 

i=0 


where. 


N—x — l ^ 

Var[7Ar(a;)] = ^ (fc + l)‘^pa:,x+k+i - ( ^ {k + l)px.x+fe+i) = '4’n{x). 

k^O ' ■ 


N—x — l 


k^O 


Then, 

ElM^ 1 1 

||M,^||2 = E[iM,^f] = E ^ (8) 

i=0 

This completes the proof. □ 

Corollary 2.4. If the distribution of the number of neighbors is such that Sn ^ 0 as N ^ 00 and 
'4 ’n = o{N), the scaled process Z^ converges to zt in uniformly on compact time intervals. 
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Corollary 2.5. If the number of initial items N is itself random and independent of the trajectory 
of Z, meaning that Z can be constructed (i) as a functional of N and (ii) of other random variables 
that are independent of N, then 

E[ sup \Z^(t) - z{t)\] <E{6NT) + 2E^/C^)exp{CLT}. 
te[o,T] 

Example 2.6 (Sparse Erdos-Renyi Graph with a Poissonian number of vertices). Suppose that 
given N, the graph Q = Q{N,clN) is a sparse Erdos-Renyi graph, i.e.pN(-,x) is the probability 
mass function of the binomial distribution Bin{N — x — l,c/N) with c > 0. Additionally, suppose 
that N — 1 is Poisson distributed with parameter h. The mean and variance of p]\[{., x) are then 
given by 

7 jv(a;) = {N -X - 1)^, = (N -x-l)-^(l - 

Define 'j(x) = c(l — x). Condition ([IJ is satisfied and as Lipschitz constant Cl = c suffices. 
Moreover, Sn = c/N and tpN < c. In this case the deterministic differential equation in ([3]) reads 

i = 1 + c(l — z) = (1 + c) — cz, 


which can be explicitly solved, resulting in 

1 c 

z{t) = p + (zo — p)e~* with p = -. 

c 

Since z(0) = 0, z{f) = p(l — e“‘). Observe that lim z{t) = p > 1. 

Furthermore, from Corolla,ru \2.5\ we obtain using Cauchy-Schwarz’s inequality that there exists 
a constant Ci such that 


E 


sup \Z^{t) — z{t)\ < cE(l/iV) + E(l/\/iV)2-\/^exp{cT} 
4e[o,T] J 

1 — exp(—/i) \ 1/2 


< C'iE(l/iV)i/2 = Ci^- 


2.1.2 Diffusion approximations with errors bounds 

We now proceed and derive a functional central limit theorem. The convergence proof again uses 
classical techniques, which we use to determine error bounds. To that end, we apply results of 
[3] which are based on results by Komlos-Major-Tusnady. These results allow one to construct 
a Brownian motion and either a Poisson process or random walk on the same probability space. 
Since we are concerned with discrete time, we need to consider the random walk case, see also 
[T]. In order to obtain explicit error bounds, we suppose stronger assumptions on the transitions 
probabilities than would be needed when only proving convergence. 

Proposition 2.7. If there exists a function p on (N,M+), and a sequence (£fc)fe=o,i,... such that 

\pN{k, [Nx]) -p{k,x)\ < 

\p{x,x-\-k) -p{y,y-\-k)\ < Mek\x-y\, 

'^k‘^\p{x,x ky/'^ - p{y,y < M|x - j/p, 

k 

k 

and if 7 is twice differentiable with bounded first and second derivatives, then the process 

wf = - z{t)) (9) 
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converges in distribution towards Wt, the unique solution of the stochastic differential equation 


dW{f) = {z{f))W {t)dt + fi'ft) dBi{t). 


(10) 


Here, Bift) denotes a standard Brownian motion, f){t) = tp{z{s)ds, and z{t) is the solution of 
Furthermore, 

E(sup|W^f(11) 

Proof. We adapt the results of Kurtz which were derived for continuous time Markov jump pro¬ 
cesses. For doing so, we can replace the Poisson processes involved in the construction of the jump 
processes by some random walks that can be used to construct discrete time Markov chains. We 
can then use exactly the same steps as in [4], by first comparing the original process with a 
diffusion of the form 

^ E Z^)ds), 

^ 1<N 0 

that is a sum of a finite number of scaled independent Brownian motions Bi. 

Rewriting the inequalities in [4j (3.6)], and using a random walk version of the approximation 
lemma of Komlos-Major-Tusnady [T] , we obtain 


e(sup jZf - Zf l) < (12) 

This leads using the results of [H Section 3] to 

E(sup|Wf - Wt\) < (13) 

which concludes the proof. □ 

Example 2.8 (ER case - Continued). The relation between the binomial coefficients and the 
Poisson distribution are well studied. Defining 


PN{k, [xlV]) 


fN - [iVx] - 1\ 

( "" "iV- 

1 '''l 

[ k ) 

ViV/ V 

n) 


Ar-[Afa;]-l 


and using (for instance) the Stein-Chen method E’ we have that 

Q 

\pN{k,[xN]) - p{k,x)\ < —p{k,x), 
which shows that the assumptions of Proposition \2.1\ are satisfied. 


2.2 LLN and CLT for the Hitting time 

If < oo, the exploration algorithm finishes at 

= inf{r e N+|Z^ = IV} < TV < oo. (14) 

This time is a hitting time for the Markov process. Since the algorithm adds precisely one 
node at each step, we have that the final number of active items is exactly i.e. At* = 
Because we wish to determine the statistical properties of At* , we will seek not only a first-order 
approximation for but also prove a central limit theorem result as the initial number of items 
N goes to infinity. From here on onward, we denote by T* the solution to z(T*) = 1. 
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Proposition 2.9. For all 5 > 0, there exists a constant Cg depending only on 5, so that 


rpnf 

zJL _ T* 
N 


> 5 


< CgUJN- 


(15) 


Furthermore, if there exist constants e, ci >0 so that 7 ( 2 ( 5 )) < 1 — e for all s > Ci, then there 
exists a constant C such that 


rpn^ 

N _ rp^ 

N 


< Cwn. 


Proof. Remark that if | 2 (s) — < 6 , then there exists a finite constant A > 0 such that 

n 


N _ rp* 

N 


< sup 2 ^(f) = sup 2 ^{t) < A5. 

tGp-i(l)-<5.z-Hl)+<5] tG[T*-5,T*+5] 


(16) 


Hence the first claim follows directly from the observation that the event 

(\T, 


N _ rji^ 

N 


>As}c{\z{s)-Zf\>S}. (17) 

Now since Zq = 0, and using that Zt* /N = z{T*) = 1 together with (^j) and ([1]), we find 


^ N 
N 


^ - T* = f 'y{z{s))ds - I jN{ZsN)ds - 


Mx* 

-^N 

N 


(18) 


zJLat* 


( 7 ( 2 ( 5 )) - 7 jv(^sAr))ds + 'y{z{s))ds- 


N 


N 


Then, using the triangle inequality, 

c^AT* 


in. _ T* 
N 


Mx* 

j,. ')N{ZsN)ds - 

-#AT* N 


„T* 


< 


17 ( 2 ( 5 )) - 7w(^sAr)Ms + |7(2(s))|(i5 


-at* 


N 


l7-/v(^sAf)|d5 + \Mrp 


'^at* 


Approximating jn by 7 and using the Lipschitz continuity of 7 and max{Tfj/N,T*) < 1, 


rp^ 

in — T* 
N 


^ N 
N 


< 2Cl sup \z{s) - Zf^l+SN + I\-f{z{s))\ds+ 1^,^ |7(2(s))|d5 + |M|1 |. 


Splitting cases, using that 7 ( 2 ( 5 )) < 1 — e for 0 < ci <5, the bound ||T^/A^ — T*||i < 1 and 

n/N < 1 , 


T, 


N _ 


N 


< 6 n + ^Cl sup 12 ( 5 ) - I + (1 - e) 


S<1 


Tl 


N rri-* 


N 




+ C' 21 t 7 ^^ + \M^^\.] 


<C 1 


Now note that similarly to our previous argumentation before, there exists a S such that 

■Tt 


{^<c^<T*}c{\z{s)-Zf\> 6 }. 


(19) 


Hence, using m together with Markov’s inequality and the Minkowski inequality, there exists a 
constant C 3 such that 


rp^ 

N _ p* 

N 


< dw +C'3||sup|2(5) - III 2 + \\M^^\\2. 

2 s<l 
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Using Proposition (0), and the fact that T^/N < 1, we obtain that 



N 




< 6 n + ^411 sup |z(s) - Z, 
2 se[o.i] 


N\ 


||M 


N 


< Sn + C4UJN + ipN/NEiT^/N) < C5UJN. 


This concludes the proof. □ 

Corollary 2.10. Suppose 7 ( 1 ) ^ 1. The random variable '/N{T^/N — T*) converges in to 
Wt* , and 


E 


rT-ljf: 

Vn 

-T*) 

1 V N 

J 


T*) (1 - 7 ( 1 )) + IUt. ] < VNuj%. 


Here, Wt* is a centered Gaussian random variable with variance 

rriT* 


a^= 


1-7(1)’ 

where mt = E[Wt^] solves the differential system 

rht =-2j{zt)mt + P(t), mg = 0 . 


( 20 ) 


( 21 ) 


Proof. First, expand 
TZ 


-f - T*) (1 - 7(1)) + IUt* I = I - T*) (1 - 7(1)) + ll^T. + 

N(tl _ T*^ (1 _ ^( 1 )) + y]v(Z)y. - z{T*)) + Wt* - W#( 

iv(^-T*)(l- 7 (l)) + y]v(^ ds-z{T*) + J^ 7 ^(Z,^)ds + + Wt* - W 

^-T*)(l-7(l)) + y]v(-^ 7{z(s))ds + ^ 7Ar(Z,^)ds + M)y.) +Wt. - W#( 


Then, use (IT5)l to simplify (with the notation that when a >b) 

'T 

N{- ■ ’ .. ' 


lN{Z,^)ds - - 7(l)Viv(^ - T*) 

+ Vn [ jN{ZsN)ds + + Wt- - Wf. 

Jo 

Vn(^ lN{ZsN)ds - ) - y(l)v^(^ - T*) + + Wt- - W, 


Finally, add and substract /.jT. -){z{s))ds, and use the triangle inequality to arrive at 


^ ^ ) (1 - 7(1)) + Wt 


< |Wt* - WtA + '/n f {'^n{Zsn) - j(z(s)))ds 

+ ^7(2(s))ds - 7(1) I + ^ll^T* 


( 22 ) 


We now bound each of the terms on the right one by one. The first term can be bounded using 
Proposition 12.71 


nwff, -Wt-]< Co 


log(lV) 

Vn 


(23) 
































The second term can be bounded using (in sequence) the triangle inequality, ([T]), Lipschitz 
continuity of 7 , and extending the integration range, i.e. 


E 


y/N 


rn/N 


JT* 


1n{Zsn) - j{z{s))ds 
n/N 


< VnE sign(^-^ - T*j J \-/n{Zsn) - ^{z{s))\d 


< y]VE[^sign(|-^-T*j {SN + \l{Z^)-7{z{s))\)ds 


< v^Ef(^w + CiSup|Zf-z(s)|)|^-r’ 


S<1 


= vN [Sn 


_ rp* 

N 


+ Cl 


sup|zf-=W|(^-r*) 


Then using Holder’s inequality, and the bound ||T^/iV — T*||i < 1, we find that 


< VN{5 


>N 


lH — T’* 
N 


+ C 2 


sup |z(s) — Z, 

s<l 


AT I 


rp^f 

N _ rp* 

N 


< vN (<5AT + C 2 


sup |z(s) — Z 

s<l 


N\ 


rp^ 

N _ rp* 

N 


Hence 


E 


\/N 


rn/N 


jNiZsN) - 'y{z{s))ds 


sup U(s) — Z, 

s<l 


N\ 


rp* 

_ rp^ 

N 


< V + C 2 

< CiVNujlf 

After a Taylor expansion around T*, it follows for the third term that 
rn/N 


y "" 7(z(s))ds = \/iV7(l)(^-T*)+v^i?w. 


and we can subsequently bound using Proposition [2j9] 

'Ttr 


v^E|i?^| < i(sup|7'|)E[(^ -T*) ] < C5 ^/Nuj%. 


Using another Taylor expansion, we can expand the fourth term as 


Vn f j{zf) - ^{z{s))ds = y/N f 'y'{z{s)){Z^ - z{s)) + RN{s)ds 

Jo Jo 

= f "/'{z{s))W^ds + Vn [ RN[s)ds 
Jo Jo 

and then bound the fourth term using Proposition 12.31 

VnEIRn] < iy]V(sup7")||^f - z(s)||i < CoVNcoI. 

Finally, using Proposition 12.71 we obtain for the third term: 


(24) 


(25) 


(26) 


(27) 


VnE[\M^, /jv - mA |] < VfVE[< M-f. - MA >]1/2 < 


rp-^ 

zM. _ 7 "^ 
N 


< VNl 


UJn- 
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Remark that —>■ 0 when 6 n = and and then all these terms 

converge to 0 as iV —>■ oo. This proves that since 7 ( 1 ) ^ 1, the limit is a Gaussian random variable 
with variance 


= E 


/ ITt* \2i 

_■ 


(28) 


Defining rrit = we find using Ito’s formula 


E[W^] = E / 2WsdWs + (l/2)2/3t 




= 2 


^\z{s))E{Wj)ds + m 


and hence rrit satisfies the differential system 


rht = -2'j{zt)mt + Pit), toq = 0 . 


(29) 


This finishes the proof. □ 

Example 2.11 (ER case - Continued). For the ER graph 7 ( 0 ;) = ipi^) = c(l — x) and z{t) = 
((1 + c)/c)(l — e“'^‘). Solving z{T*) = 1 gives T* = ln(l + c)/c. The differential equation for P{t) 
is given hy 

Pit) = f^izis)) = (1 + c)e“'=‘ - 1, 


and the solution to is then 

rat = exp(— 2 ct)(l — exp(ct))(exp(ct) — 2 c — 1 ) —, 

2 c 

ultimately leading to 


(30) 


rriT* c 

( 1 - 7 ( 1))2 = 2 (c+l) 2 ' 


(31) 


2.3 Continuous time version 

Our arguments that have led to our results for discrete time can be used in a similar fashion to 
obtain results for continuous time. We state the convergence results for fixed time intervals without 
proof. 

Proposition 2 . 12 . Suppose that there exist a function on M'*', 7 such that 

iNix) = ^{^'] + 5 n with Sn -)■ 0. (32) 

\ iV / V—>00 

and suppose that the function gix) = (1 — x)^ix) is a (CL)-Lipschitz function such that 
gNix) = (1 “ TV^oo 

Then 

e( sup \Z^it) - z(t)l) < (a(v + 2 ^XCnT) explACiT}, 

^te[o.T] ^ 

where a'j^ goes to zero with N, Cjq = ^ and z(t) is the solution of the following 

(deterministic) differential equation 


i = A(1 - z)(l + 7 (z)). 


(34) 
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Suppose that there exists a function tp on IR._|_ such that 


lim 
N ^OO 




= 0 . 


The process 

wf = yiv(zf - z(t)) 

converges in distribution towards W which is the solution of the following stochastic differential 
equation: 


dW{t) = A[-(l + -f{z{t))) + i'{z{t)){l - z{t))\W{t)dt + ^^dBit), (35) 

where B{t) is a standard Brownian motion, j3{f) = A f* (1 — z{s)){'ip{z{s)) + (1 + 7 (z(s))^)cis, and 
z{t) is the solution of p4p . 
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